(19) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(11) 



Oil 

EP 0 926 596 A2 



(12) 



(43) Date of publication: 

30.06.1999 Bulletin 1999/26 

(21) Application number: 98310182.5 

(22) Date of filing 11.12.1998 



EUROPEAN PATENT APPLICATION 

(51) intciA G06F 9/45, G06F 1/32 



(84) Designated Contracting States: 


(72) Inventor: Hurd, Linda L. 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Sugar Land, Texas 77479 (US) 


MC NL PT SE 




Designated Extension States- 


(74) Representative: Potter, Julian Mark et al 


AL LT LV MK RO SI 


D. Young & Co., 




21 New Fetter Lane 


(30) Priority: 23.12.1997 US 68656 P 


London EC4A 1DA(GB) 


(71) Applicant: TEXAS INSTRUMENTS INC. 




Dallas, Texas 75243 (US) 





(54) Processor and method for reducing its power usage 



(57) A method of optimi2ing assembly code of a 
VLIW processor (10) or other processor that uses mul- 
tiple-instruction words (20). each of which comprise in- 
structions to be executed on different functional units 
(11d and 11 e) of the processor (10). The instruction 



words (20) are modified in accordance with one or more 
code optimization techniques (FIGURE 6). Typically, the 
modifications tend to result in fewer cycle-to-cycle bit 
changes in the machine code, which results in reduced 
power consumption. 
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Description 

TECHNICAL FIFI.D OF THE INVENTION 

5 [0001] This invention relates to processors, and more particularly, but not exclusively, to methods of using program- 
ming instructions in a manner that reduces the power consumption of a processor. 

BACKGROUND OF THE INVENTION 

W l ^°!L PO !T effiC ' ency ,or Passer-based equipment is becoming increasingly important as people are becoming 
more attuned to energy conservation issues. Specific considerations are the reduction of thermal effects and operating 
costs. Also, apart from energy conservation, power efficiency is a concern for battery-operated processor-based equip- 
ment, where ,t ,s desired to minim.ze battery size so that the equipment can be made small and lightweight The 

>s r e ZlTeT^T nr be e ' ther eqUiPment d6Si9ned eSPeCia ' ,y f ° r 96neral C ° mpUtin9 ° f e ^» menl havi "9 
[0003] From the standpoint of processor design, a number of techniques have been used to reduce power usaqe 
These techniques can be grouped as two basic strategies. First, the processor's circuitry can be designed to use less 
power. Second, the processor can be designed in a manner that permits power usage to be managed 
[0004] On the other hand, given a particular processor design, its programming can be optimized for reduced power 
consumption Thus, from a programmer's standpoint, there is often more than one way to program a processor to 
perform the same function For example, algorithms written in high level programming languages can be optimized for 
efficency ,n terms of time and power. Until recently, at the assembly language level, most optimization techniques have 
been primarily focussed on speed of execution without particular regard to power use 

[0005] The programmer's task of providing power efficient code can be performed manually or with the aid of an 
automated code analysis tool. Such a tool might analyze a given program so to provide the programmer with information 

rani, ?ITn U f a9 ,ti n, ° c r T a l i °c n ° ,her SUCH ,00 ' S mi9ht aCtUa " y aSSiSt the P r °9'ammer in generating optimized code. 
0006] U.S. Paten. No. 5 557,557, to Franz, etal , entitled "Processor Power Profiler", assigned to Texas Instruments 
Incorporated, describes a method of modeling power usage during program execution. A power profiler program an- 
Ho^h h P TPc oT d P o OVideS Dr °9 rammer wi,h Tarnation about energy consumption. A power profiler is also 
described ,n U S Patent Serial No 06/046,811 , to L Hurd, entitled » Module-Configurable, Full-Chip Power Profiler- 
assigned to Texas Instruments Incorporated. 

[0007] Once the power requirements of a particular program are understood, the code can be optimized Automating 
this aspect of programming requires a code generation tool that can restructure computer code, internal algorithms as 
well as supporting functions, for minimum power usage. 

SUMMARY OF THE INVENTION 

[0008] One aspect of an embodiment of the invention is a method of optimizing computer programs for power usage 
t is based on the recognition that power consumption is reduced when there is a minimum of change in the machine- 
level representation of the program from each CPU cycle to the next. The method is useful for various types of proc- 
essors that execute "multiple-instruction words" (as defined herein) by different functional units of the processor Ex- 
f™!? °l P rocessors VLIW (very long instruction word) processors and dual datapath processors 
[0009] The method comprises a set of steps, any of one which may be performed independently. Each step involves 
scanning the code and comparing a given field or other code sequence within instructions. Generally, it is the code 
syntax that is of interest, as opposed to its functionality. It is determined if there are code sequences where cycle-to- 
cycle bn changes in the machine code representation of that code sequence can be minimized. Then the code is 
modified if this can be done without adversely affecting code functionality. 

[001 1 0] For example, one aspect of an embodimenl of the invenlion is a method where the code sequences of interest 
are functional unit assignments. Typically, each instruction of the instruction word occupies a "slot" of the word For 
each slot, the field that identifies the functional unit is scanned. Cycle-to-cycle bit changes ,n this field are reduced by 
ZxaUected ,nS,rUC "° nS W " hin instruc,ion Ms Because instructions are merely rearranged, code functionality is 

[0011] An advantage of an embodiment of the invention is that rt is directed to optimization at the processor archi- 
tecture evel, rather than to high level programming. This permits a processor to be programmed in a manner that is 
most efficient for that processor The method can be easily adapted to the characteristics of the processor and its 

instruction set. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] FIGURE 1 is a block diagram of a VLIW DSP processor 

[0013] FIGURE 2 illustrates the basic format of a fetch packet used by the processor of FIGURE 1. 
5 [0014] FIGURE 3 illustrates an example of the fetch packet of FIGURE 2 

[0015] FIGURE 4A illustrates the mapping of the instruction types for the processor of FIGURE 1 to the functional 
units in its datapaths. 

[0016] FIGURE 4B is a table describing the mnemonics of FIGURE 4A. 
[0017] FIGURE 5 illustrates a fetch packet having multiple execute packets. 

10 [0018] FIGURE 6 illustrates a code optimization process in accordance with an embodiment of the invention. 

[0019] FIGURES 7A and 7B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 63 of FIGURE 6. 
[0020] FIGURES 8A and 8B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 63 of FIGURE 6. 

is [0021] FIGURES 9A and 9B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 63 of FIGURE 6. 
[0022] FIGURES 1 0A and 10B illustrate an example of unoptimized code together with the corresponding optimized 
code respectively, where the optimization has been performed in accordance with Step 64 of FIGURE 6. 
[0023] FIGURES 1 1 A and 1 1 B illustrate an example of unoptimized code together with the corresponding optimized 

20 code, respectively, where Ihe optimization has been performed in accordance with Step 65 of FIGURE 6. 

[0024] FIGURES 1 2A and 1 2B illustrate an example of unoptimized code together with the corresponding optimized 
code respectively, where the optimization has been performed in accordance with Step 65 of FIGURE 6. 
[0025] FIGURES 1 3A and 1 3B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 67 of FIGURE 6. 

2S [0026] FIGURES 14Aand 14B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 66 of FIGURE 6. 
[0027] FIGURES 1 5A and 1 5B illustrate an example of unoptimized code together with the corresponding optimized 
code, respectively, where the optimization has been performed in accordance with Step 66 of FIGURE 6. 

30 DETAILED DESCRIPTION OF THE INVENTION 

[0028] Embodiments of the invention described herein are directed to power management for microprocessors. An 
underlying principle of operation is that the programming provided to the processor can be optimized so as to reduce 
power usage. Given a particular instruction set, a program using these instructions can be analyzed to detect the 
35 presence of non-optimal instruction sequences. These sequences can be modified so that power usage is more effi- 
cient, without adversely affecting code functionality. 

[0029] The method of embodiments of the invention is most useful with VLIW (very long instruction word) processors, 
which are characterized by their ability to execute multiple instructions in parallel using different functional units within 
the processor. Embodiments of the invention are also useful with "dual datapath" processors, which execute two in- 

40 structions in parallel on two datapaths. Both types of processors execute "multiple-instruction words" in parallel in more 
than one functional unit. However parallelism is not a limitation of embodiments of the invention, and any processor 
that fetches and decodes more than one instruction at a time will benefit from the optimization process. As explained 
below, for such processors, cycle-to-cycle instruction fetching, decoding, and dispatching can be optimized for power 
if the code is arranged properly. 

^5 [0030] In light of the preceding paragraph, the term "processor" as used herein may include various types of micro 
controllers and digital signal processors (DSPs). To this end, the following description is in terms of DSPs -- the TMS320 
family of DSPs and the TMS320C6X DSP in particular. However, this selection of a particular processor is for purposes 
of descriplion and example only. 

so Processor Overview 

[0031] FIGURE 1 is a block diagram of a DSP processor 10. As explained below, processor 10 has a VLIW archi- 
tecture, and fetches multiple-instruction words (as "fetch packets") to be executed in parallel (as "execute packets") 
during a single CPU clock cycle In the example of this description, processor 10 operates at a 5 nanosecond CPU 
55 cycle time and executes up to eight instructions every cycle. 

[0032] Processor 10 has a CPU core 11, which has a program fetch unit lla, and instruction dispatch and decode 
units 11b and 11c r respectively To execute the decoded instructions, processor 10 has two datapaths 11 d and 11e 
[0033] Instruction decode unit 11c delivers execute packets having up to eight instructions to the datapath units 11d 
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and 11 e every clock cycle. Datapaths 11 d and 11 e each include 16 general-purpose registers. Datapaths 11dand 11e 
each also include four functional units (L S, M, and D), which are connected to the general-purpose registers. Thus, 
processor 10 has eight functional units, each of which may execute one of the instructions in an execute packet. Each 
functional unit has a set of instruction types that it is capable of executing. 
5 [0034] The control registers 1 1 f provide the means toconfigure and control various processor operations. The control 
logic unit 11 g has logic for control, test, emulation, and interrupt functions. 

[0035] Processor 10 also comprises program memory 12, data memory 13, and timer 14. Its peripheral circuitry 
includes a direct memory access (DMA) controller 15, external memory interface 16, host port 17, and power down 
logic 18 The power down logic 18 can halt CPU activity peripheral activity, and timer activity to reduce power con- 
io sumption. These power down modes, as well as features of processor 10 other than the features of embodiments of 
the present invention, are described in U.S. Patent Serial No. 60/046,811, referenced in the Background and incorpo- 
ratec herein by reference. 

[0036] Processor 10 executes RISC-like code, and has an assembly language instruction set. In other words, each 
of its VLI Ws comprises RISC-type instructions. A program written with these instructions is converted to machine code 
by an assembler Processor 10 does not use microcode or an internal microcode interpreter as do some other proc- 
essors. However, the invention described herein could be applicable regardless of whether RISC-like instructions con- 
trol the processor or whether instructions are internally interpreted to a lower level. 

[0037] In the example of this description eight 32-bit instructions are combined to make the VLIW. Thus, in operation, 
32-bit instructions are fetched eight at a time from program memory 12. to make a 256-bit instruction word. The "fetch 
packet" is comprised of these eighl instructions fetched from memory 12. 

[0038] FIGURE 2 illustrates the basic format of the fetch packet 20 used by processor 10. Each of the eight instruc- 
tions in fetch packet 20 is placed in a location referred to as a "slot" 21. Thus, fetch packet 20 has Slots 1 : 2,. .8 
[0039] Processor 10 differs from other VLIW processors in that the entire fetch packet is not necessarily executed 
in one CPU cycle. All or part of a fetch packet is executed as an "execute packet". In other words, a fetch packet can 
bo fully parallel, fully serial, or partially serial. In the case of a fully or partially serial letch packet, whore the fetch 
packet's instructions require more than one cycle to execute, the next fetch can be postponed. This distinction between 
fetch packets and execute packets permits every fetch packet to contain eight instructions, without regard to whether 
they are all to be executed in parallel. 

[0040] For processor 10 the execution grouping of a fetch packet 20 is specified by a "p-bit" 22 in each instruction. 
30 in operation, instruction dispatch unit 11b scans the p-bits, and the state of the p-bit of each instruction determines 
whether the next instruction will be executed in parallel with that instruction. If so, its places the two instructions are in 
the same execute packet to be executed in the same cycle. 

[0041] FIGURE 3 illustrates an example of a fetch packet 20. Whereas FIGURE 2 illustrates the format for the fetch 
packet 20, FIGURE 3 illustrates an example of instructions that a fetch packet 20 might contain. A fetch packet 20 
35 typically has five to eight instructions, and the fetch packet 20 of FIGURE 3 has seven. Each instruction has a number 
of fields which ultimately are expressed in bit-level machine code. 

[0042] The 1 1 characters signify that an instruction is to execute in parallel with the previous instruction, and is coded 
as p-bit 22. As indicated, fetch packet 20 is fully parallel, and may be executed as a single execute packet. 
[0043] The square brackets [] signify a conditional instruction, surrounding the identifier of a condition register Thus, 
*o the first instruction in FIGURE 3 is conditioned on register A2 being nonzero. A ! character signifies "not", so that a 
condition on A2 being zero would be expressed as [!A2]. The conditional register field comprises these identifiers. 
[0044] The opfield contains an instruction type from the instruction set of processor 1 0. Following the instruction type 
is the designation of the functional unit that will execute the instruction. As stated above in connection with FIGURE 
1, each of the two datapaths 11 d and 11 e has four functional units. These functional units are L (logical), S (shilt), M 
(multiply), and D (data) The opfield thus has the syntax (instruction type]. [functional unit identifier]. 
[0045] Some instruction types can be performed by only one functional unit and some can be performed by one of 
a number of them. For example, only the M unit can perform a multiply (MPY). On the other hand, an add (ADD) can 
be performed by the L, S, or D unit. The correspondence of functional units to instructions is referred to herein as their 
"mapping". 

so [0046] FIGURE 4A is a table illustrating, for processor 10. the mapping of instruction types to functional units. It is 
useful for an understanding of the examples set out below in connection with code optimization. FIGURE 4B illustrates 
the description of each mnemonic. 

[0047] The mapping of functional units to instruction typos determines which instructions can be executed in parallel, 
and therefore whether a fetch packet will become more than one execute packet. For example, if only the M unit can 
perform a multiply (MPY) ; an execute packet could have two MPY instructions, one to be executed by each of the two 
datapaths 11d and 11e. In contrast, the L, S, and D units are all capable of executing an add (ADD), thus an execute 
packet could contain as many as six ADD instructions 

[0048] Referring again to FIGURE 3, the instruction's operand field follows the opfield Depending on the instruction 
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type, the operand field may identity one or more source.registers, one or more constants, and a destination register 
[0049] FIGURE 5 is an example ol code having multiple execute packets per fetch packet 20 In this example, there 
are two fetch packets 20 The first fetch packet 20 is executed in three execute packets. EP1. EP2. and EP3. The 
second fetch packet 20 is executed in four execute packets. EP1 . EP2. EP3. and EP4. 
s [0050] To generalize the above-described processor architecture, an executable instruction word. i.e.. an execute 
packet, contains up to eight instructions to be executed in parallel during a CPU cycle. Each instruction in an execute 
packet uses a different one of the functional units (L. D. S or M) of datapaths 11 d and 11e. The instruction mapping 
determines which instruction types can be duplicated within an execute packet. 

[0051] The use of instruction words in this manner lends itself to unique techniques for power optimization. As ex- 
io plained below, within an irstruction word, instructions can be arranged so that, for each slot, changes from cycle to 
cycle are minimized 

Power Optimization Process 

is [0052] FIGURE 6 illustrates a code optimization process in accordance with an embodiment of the invention. Each 
step involves a different code optimization technique. Each step could be performed alone as an independent code 
optimization technique, or in combination with one or more of the other steps. 

[0053] Each of these steps is explained below, together with one or more examples of code optimization in accord- 
ance with that step. The code examples are consistent with the architecture of processor 10 as described above in 
20 connection with FIGURES 1 - 5 Specifically the examples are consistent with a processor 10 thai uses fetch packets 
that may be divided into execute packets and special considerations for this distinction between fetch packets and 
execute packets are noted 

[0054] However embodiments of the invention are equally useful for processors whose fetch packets are the same 
as the execute packets, as well as for processors that do not use "packets" in the conventional sense. The common 

25 characteristic of the code to be optimized is that it has "mulitplc-instruction words". The term "multiple-instruction word" 
is used to signify a set of instructions, where the instructions within the set are grouped at some point within the 
processor for processing (which may include fetching, decoding, dispatching, executing : or some combination of these 
functions), and where the executing is by different functional units of the processor. The "multiple-instruction word" 
may be structured as a fetch packet or as an execute packet, or it may have a structure different from a conventional 

30 packet structure 

[0055] In general, each optimization technique is ultimately directed to finding and minimizing cycle-to-cycle bit 
changes in the binary representation of the assembly code. This is achieved without substantially affecting the overall 
functionality in terms of the number and type of instructions. Because the functionality is substantially the same, the 
result is less node switching when instructions are fetched from program memory and when they are decoded and 
35 dispatched This in turn, reduces powerconsumption. Each step of the overall optimization process is directed to finding 
and minimizing a different category of bit changes. In a general sense, the code is scanned for various syntax features 
as opposed to functional features. 

[0056] Step 61 of the code optimization process is re-ordering slot assignments within fetch packets. For each fetch 
packet, the instructions are viewed by slot assignment. It is determined whether instructions within a fetch packet can 
40 be re-ordered so that changing of functional units from cycle to cycle is minimized. The effect of Step 61 is a "vertical 
aligning" of functional unit assignments. 

[0057] FIGURES 7A and 7B illustrate an example of Step 61. FIGURE 7A shows an instruction stream 70 before 
the optimization of Step 61. FIGURE 7B shows almost the same instruction stream 70, optimized in accordance with 
Step 61. 

45 [0058] Instruction stream 70 has three fetch packets. As illustrated, in the second fetch packet, the optimization of 
Step 61 moves an instruction having an ADD. LI X opfield to a slot in which there was an ADD. LI opfield in the previous 
fetch packet. The opfield is the same with the addition of an "X" signifying a cross path. In the third fetch packet, Step 
61 moves two instructions, one with an opfield ADD.L1X and the other with an opfield ADD.L2X, to the same slots as 
instructions having corresponding opfields in the pievious two fetch packets. Likewise, Step 61 moves the B (branch) 

so instruction so that the LDW D2 instruction may occupy the same slot as the LDW. D2 instructions of the previous packets. 
A NOP (no operation) instruction is used as a place holder so that the same slots will have the same instruction type. 
[0059] Step 61 can be applted to fetch packets having more than one execute packet. In this case, the order of the 
execute packets must be preserved, but slot assignments can be changed within an execute packet In general, code 
having a single execute packet per fetch packet, such as the code of FIGURES 7A and 7B, will be optimized to a greater 

SB extent than code having multiple execute packets per fetch packet. 

[0060] The above examples are specific to processor 10, whose instructions have an opfield containing both the 
instruction type and the functional unit assignment For other processors, the functional unit assignment may be in a 
different field In any event, the optimization of Step 61 is directed to re-ordering instructions within fetch packets so 
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as to align functional unit assignments. This alignment of functional unit assignments reduces the number of bits chang- 
ing in each slot from one cycle to the next 

[0061] Step 63, like Step 61 , aligns functional unit assignments to avoid unnecessary switching between them. How- 
ever Step 63 involves providing new functional unit assignments rather than re-ordering existing instructions 
[0062] Step 63 is based on the fact that there are certain instructions that are executable by more than one type of 
functional unit For example, referring again to FIGURE 4, processor 10 has certain instructions that can be executed 
on both the L and S functional units, and some of these can be executed on the D units as well. 
[0063] FIGURES SA and 8B are examples of unoptimized code and optimized code, respectively, where the optimi- 
zation has been performed in accordance with Step 63. As indicated, an instruction stream has three fetch packets, 
and each fetch packet has an ADD instruction in the same slot. The unoptimized code of FIGURE 8 A is executable 
because the ADD instruction can be performed on any of the functional units (D, S : or L). However, switching between 
them is unnecessary. Thus, in FIGURE 8B, the same functional unit (L) is used for all three ADD instructions 
[0064] FIGURES 9A and 9B are another example of optimization in accordance with Step 63. This example illustrates 
optimization of fetch packets having multiple execute packets. In this case, the cycle-to-cycle analysis of functional 
unit assignments is directed to execute packets. However, the same concept would apply if the execute packets were 
fetched as fetch packets. 

[0065] The optimization illustrated by FIGURES 9A and 9B is best understood by charting the cycle-by-cycle usage 
of the functional units. For the code of FIGURE 9A. which is the code before optimization, such a chart would be: 
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[0066] For the optimized code of FIGURE 9B. the chart would be: 
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As in the example of FIGURES 8A and SB, functional units are re-assigned to avoid unnecessary switching between 
functional units from cycle to cycle. The optimization results in better alignment of the functional units. 
[0067] Step 64 is directed to instructions having conditional field assignments. A characteristic of processor 10 is 
that the 3-bit conditional register field is all 0's for an unconditional instruction Conditions of registers B0, B1 , and A1 
have only one "1 " in the conditional field On the other hand, conditions of registers B2 and A2 have two '1's w . Thus, 
to minimize the number of bits changing from unconditional instructions to conditional instructions, registers B0, B1. 
and A1 are preferred. 

[0068] FIGURES 10A and 10B illustrate an example of Step 64. Comparing the unoptimized code of FIGURE 10A 
to the optimized code of FIGURE 10B. in the first cycle, Step 64 exchanges the ADDs on S2 and D2. As a result of 
this modification, the number of bits changing in the conditional register field and operand field is reduced. Considering 
only Slots 5 and 6, in the unoptimized code, the conditional and operand fields are: 
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This resulls in 1 5 bit changes: 8 for the L2 instruction (2+2+2+2) and 7 for the D2 instruction (2+1 +2+2). In the optimized 
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code Slots 5 and 6. these fields are: 
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This results in 1 3 bit changes: 5 for the 12 instruction (0+1 +2+2) and 8 for the D2 instruction (2+2+2+2). This optimization 
reduces power usage by instruction dispatch unit 11b and instruction decode unit 11c. 

to [0069] Step 65 of the optimization process analyzes the operand field of the instructions Operands are re-ordered 
or registers re-assigned, if this would result in a lower number of bits changing in the operand field. As described above 
in connection with FIGURE 3. depending on the instruction type, the operand field will identify various source registers, 
a destination register, or constants. It is a large field in proportion to the total bit size of the instruction. For example, 
for processor 10. the operand field is 15 bits of the 32-bit instructions Thus, Step 65 can have an important effect on 

is power optimization. 

[0070] FIGURES 11 A and 11 B are an example of optimization in accordance with Step 65. In this example, the re- 
ordering of operands is within an instruction. The unoptimized code of FIGURE 11 A is optimized in FIGURE 11B. Two 
fetch packets are shown, with each fetch packet being executed in a single execute cycle. 
[0071] Considering only Slot #2 for each of the two cycles, the unoptimized code of FIGURE 11 A is: 
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The optimized code of FIGURE 11 B is: 
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The binary code for 11 is 1011 , and the binary code for 12 is 1100. Thus, the re-ordering of the operands in slot #2 
reduces the number of bits changing in the operand field by six. 

[0072] FIGURES 12A and 12B are another example of Step 65, showing unoptimized code and the corresponding 
optimized code, respectively. Here, the re-ordering of operands involves a swilch between two different instructions. 
Slots 2 and 8 of three fetch packets are shown. Comparing the fetch packets of the second cycle (FP2) of the unopti- 
mized code of FIGURE 12A to the optimized code of FIGURE 12B, the SUB instructions on S2 and L2 have been 
switched. This reduces the number of bits changing in the operand fields of Slots 2 and 8. 

[0073] Step 65 can also be accomplished with an overall assessment of register use. When there is a choice of 
registers to use in a given instruction, the register that causes the fewest bits to change from the previous or next 
instruction can be selected. 

[0074] Step 67 is re-arranging NOP (no operation) instructions so as to provide a smoother code profile. More spe- 
cifically, Step 67 determines whether there are NOPs that can be moved from one fetch packet to another without 
affecting the functionality of the code 

[0075] FIGURES 13A and 13B illustrate an example of unoptimized code and the corresponding optimized code, 
respectively, where the optimization is in accordance with Step 67. The code has eight fetch packets. FP1...FP8. The 
shaded slots contain instructions that are not NOP instructions. As illustrated in the example of FIGURE 1 3B, a number 
of NOP instructions have been moved from one fetch packet to another. Because a NOP instruction is all O's, their 
placement has a significant effect on the number of bits changing from cycle to cycle. 

[0076] Step 68 is adding dummy instructions to reduce the number of times that a slot switches from NOP to a non- 
NOP instruction back to a NOP instruction. These dummy instructions duplicate most of the previous or upcoming 
instruction without adversely affecting data integrity. 

[0077] FIGURES l4Aand 14B are an example of unoptimized code and the corresponding optimized code, respec- 
tively, where the optimization is in accordance with Step 68. Only a single slot of three fetch packets is shown. FIGURE 
14A is an example of unoptimized code, having a NOP instruction in Slot 2 in the second cycle. FIGURE 14B is the 
optimized code, where the NOP has been replaced with a dummy MPY instruction. The dummy instruction does not 
affect the integrity of the data because the result has been placed in a destination register, Bxx, which is an unused 
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register in the code segment Because the dummy instruction duplicates much of the preceding and following instruc- 
tions the internal toggle artrvily of processor 10 is reduced. Step 68 is most effective for loop code segments 
[0078] FIGURES ISA and 15B illustrate another example of unoptimized code and the corresponding optimized 
code, respectively, where the opiimi/alion is in accordance with Step 68. This example is of a code segment within a 

s loop. As in FIGURE 14A. in the unoptimized code of FIGURE 15 A. in Slot 2. the instructions switch from a non-NOP 
to a NOP to a non-NOP In the optimized code of FIGURE 1 5B, the dummy instruction is a false conditional instruction. 
For false conditional instructions, the transfer of the result from functional unit to destination register is always disabled 
A conditional register BO has been reserved for use with dummy instructions. Before entering the loop, the conditional 
register is set to some value In the example of FIGURES 15A and 15B : BO is used for the dummy instruction register 

10 and is also the loop counter Because BO is nonzero until the final pass of the loop, for all but the final pass, the result 
of the conditional instruction is not written to A12. On the final pass, the result is written to A12, However, because 
A12 is not written to in the preceding instruction and is not used as a source in the following instruction, data integrity 
is not affected In cycle 3 the instruction writes to A12, which was the original function of the code. 
[0079] Typically, the optimal djmmy instruction for Step 68 will be a dummy instruction using a false conditional, 

1 $ such as in the example of FIGURES 1 5A and 1 5B. However, in some cases, such as when a conditional register is not 
available, an alternative dummy instruction, such as that of FIGURES 14A and 14B, may be used. As a result of Step 
68, fewer bits change state in the in-coming instruction stream from program memory 12. Also, fewer nodes change 
in decode unit 11c. 

[0080] Step 69 of the optimization process is to analyze address locations of fetch packets in program memory 12. 
20 For sections of code that are executed repeatedly, such as in loops, the number of bils changing on program memory 
address lines can be minimized 

[0081] As a simplified example of Step 69 assume that a first fetch packet of a loop has address ... 0111 and the 
next has the address ... 1 000 in program memory 12. Each time the program memory 1 2 switches from accessing the 
first packet to accessing the second packet, four address bits change. If the second packet were moved to address 
2S 0110. then only one bit would change 

Automation of the Optimization Process 

[0082] Each of the above-described optimization techniques could be performed manually by an assembly code 
30 programmer However, in more sophisticated embodiments of the invention, one or more of the techniques are per- 
formed automatically, with a code generation tool. Such a tool would be programmed to detect code sequences in 
which a particular technique is applicable and to perform the optimization called for by that technique. 
[0083] Some of the above-described steps are accomplished without affecting the functionality of the code from one 
cycle to the next. These steps include Steps 61 63, 64 ; 65. and 69. 
35 [0084] Other of the above-described steps are capable of affecting code functionality. These steps include Steps 67 
and 68. For these optimization techniques, the automated optimization process could include heuristic rules to resolve 
functionality issues. Alternatively, the optimization process could output a message to the programmer, indicating that 
an optimization might be possible at the programmer's option. 

40 Other Embodiments 

[0085] Although an embodiment of the present invention has been described in detail, it should be understood that 
various changes, substitutions, and alterations can be made hereto without departing from the spirit and scope of the 
invention as defined by the appended claims. 

4 $ [0086] The scope of the present disclosure includes any novel feature or combination of features disclosed therein 
either explicitly of implicitly or any generalisation thereof irrespective of whether or not it relates to the claimed invention 
or mitigates any or all of the problems addressed by the present invention. The applicant hereby gives notice that new 
claims may be formulated to such features during the prosecution of this application or of any such further application 
derived therefrom. In particular, with reference to the appended claims, features from dependent claims may be com- 

so bined with those of the independent claims and features from respective independent claims may be combined in any 
appropriate manner and not merely in the specific combinations enumerated in the claims. 

[0087] Further and particular embodiments of the invention are enumerated in the following numbered statements. 

1. A method of reducing power usage by a processor that processes multiple-instruction words, such that instruc- 
ts tions in each said of said words are executed by different functional units of said processor, during one or more 
processor cycles, comprising the steps of: 

comparing, for the first instruction of each of a number of instruction words, functional unit assignments; 
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determining whether, from cycle to cycle, the number of bit changes in the binary representation of said func- 
tional unit assignments can be reduced; 

modifying at least one of said first instructions in accordance with said determining step; and 
repeating said comparing, determining and modifying steps for each next instruction of said number of in- 
5 st ruction words. 

2. The method of statement 1, wherein said modifying step is performed by re-ordering instructions within said 
instruction words. 

io 3. The method of statement 1 or 2, wherein said modifying step is performed by replacing a functional unit assign- 

ment with another functional unit assignment. 

4. A method of reducing power usage by a processor that processes multiple-instruction words, such that instruc- 
tions in each said of said words are executed by different functional units of said processor, during one or more 

is processor cycles, comprising the steps of: 

comparing, for the first instruction of each of a number of instruction words, operand fields: 
determining whether, from cycle to cycle, the number of bit changes in the binary representation of any of said 
operand fields can be reduced: 
20 modifying al least one of said first instructions in accordance with said determining step, and 

repeating said comparing, determining, and modifying steps for each next instruction of said number of in- 
struction words. 

5. The method of statement 4, wherein said comparing, determining, and modifying steps are directed to operands 
25 within each said instruction, and wherein said modifying step is performed by rc-ordoring operands. 

6. The method of statement 4 or 5 t wherein said comparing, determining, and modifying steps are directed to 
operands within each said instruction, and wherein said modifying step is performed by re-assigning operand 
locations 

30 

7. A method of reducing power usage by a processor that processes multiple-instruction words, such that instruc- 
tions in each said of said words are executed by different functional units of said processor during one or more 
processor cycles, comprising the steps of: 

35 comparing the first instruction of each of a number of instruction words; thereby detecting no-operation in- 

structions: 

determining whether, from cycle to cycle, the number of bit changes in the binary representations of any of 
said first instructions can be reduced: 

modifying at least one of said first instructions in accordance with said determining step; and 
40 repeat said comparing, determining, and modifying steps for each next instruction of said number of instruction 

words. 

8. The method of statement 7, wherein modifying step is performed by moving said no operation instruction from 
one of said instruction words to another. 

45 

9. The method of statement 7 or 8, wherein modifying step is performed by replacing said no operation instruction 
with a dummy instruction. 

10. A method of reducing power usage by a processor that processes multiple-instruction words, such that instruc- 
so tions in each said of said words are executed by different functional units of said processor, during one or more 

processor cycles, comprising the steps of: 

scanning said multiple-instruction words to locate one or more loops of said multiple-instruction words; 
comparing th© program memory addresses of said words within said loops; 
55 determining whether, from cycle to cycle, the number of bit changes in the binary representations of any of 

said program memory addresses can be reduced; and 

modifying at least one of said addresses in accordance with said determining step 
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11 A method for optimizing a computer program for minimum power comsumption by a computer executing said 
program comprising the steps of: y 

finding cycle-to-cycle bit changes in a binary representation of said program in assembly language code 
minimizing cycle-to-cycle bit changes in said binary code by at least one of the following 
aligning functional unit assignments to reduce the number of bits changing each time slot of an instruction 
word from one cycle to the next, or 

for instructions executable by more than one functional unit ass.gning functional units to avoid unnecessary 
bit switching from cycle-to-cycle, or 

minimizing the number of bits changing caused by changing from unconditional to contitional instructions or 
vice versa, or 

reordering operand and/or register assignments to reduce the number of bits changing in operand fields or 
moving non-NOPs between fetch packets without affecting code functionality, or 

adding dummy instructions to reduce the number of times an instruction word slot switches from NOP to non- 
NOP to NOP without affecting data integrity, or 

modifying address sequences to minimize the number of address bits that change between execution packets. 



Claims 
1. 



so 7. 



55 



9. 



A method for i educing power usage by a processor that processes multiple-instruction words, such that instructions 
in each said of said words are executed by different functional units of said processor, during one or more processor 
cycles, comprising the steps of; 

comparing the syntax of a number of said instruction words; 

determining whether, from cycle to cycle, the number of bit' changes tn the binary representations of any of 
said instruction words can be reduced by changing bits without substantially affecting functionality of said 
instruction words: and 

modifying at least one of said instruction words in accordance with said determining step 

The method of Claim 1 , wherein said comparing, determining, and modifying steps are directed to a functional unit 
identifier within each said instruction, and wherein said modifying step is performed by reordering instructions 
within said instruction words. 

The method of Claim 1 or Claim 2, wherein said comparing, determining, and modifying steps are directed to a 
functional unit assignment within each said instruction, and wherein said modifying step is performed by replacing 
said functional unit assignment with another functional unit assignment. 

The method of any of Claims 1 to 3, wherein said comparing, determining and modifying steps are directed to a 
conditional register assignment within each said instruction, and wherein said modifying step is performed bv re- 
assigning a conditional register 

The method of any of claims 1 to 4, wherein said comparing, determining, and modifying steps are directed to 
operands within each said instruction, and wherein said modifying step is performed by re-order.ng operands. 

The method of any of claims 1 to 5. wherein said comparing, determining, and modifying steps are directed to 
operands within each said instruction, and wherein said modifying step is performed by re-assiqninq operand 
locations. » » r 

The method of any of claims 1 to 6, wherein said comparing, determining, and modifying steps are directed to no- 
operation instructions, and wherein said modifying step is performed by moving said nooperation instruction from 
one of said instruction words to another. 

The method of any of claims 1 to 7, wherein said comparing, determining, and modifying steps are directed to no- 
operation instructions, and wherein said modifying step is performed by replacing said nooperation instructions 
with dummy instructions. 

The method of any of claims 1 to 8, wherein said processor is a very long instruction word processor 
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10. The method of any of claims 1 to 9. wherein said processor is a dual datapath processor. 

11. The method of any of claims 1 to 10, wherein said multiple instruction words are fetch packets, such that all in- 
structions in each of said instruction words are fetched from a memory at substantially the same time. 

12. The method of any of Claims 1 to 11 , further including: 



scanning said multiple-instruction words to locate one or more loops of said multiple-instruction words: and 
wherein said comparing determining, and modifying steps are directed to reducing the number of bit changes 
10 in the binary representations of any of said program memory addresses. 
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(54) Processor and method for reducing its power usage 



(57) A method of optimizing assembly code of a 
VLIW processor (1 0) or other processor that uses mul- 
tiple-instruction words (20), each of which comprise in- 
structions to be executed on different functional units 
(11 d and 11e) of the processor (10). The instruction 



words (20) are modified in accordance with one or more 
code optimization techniques (FIGURE 6). Typically, the 
modifications tend to result in fewer cycle-to-cycle bit 
changes in the machine code, which results in reduced 
power consumption. 
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